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[57] ABSTRACT 

A game play system allows remote players to participate in 
a concurrent simulation of a live event as the live event is 
occurring. The system gathers input from sensors located at 
the live event, preprocesses this input, and transfers il to a 
computer system, which uses this input to create a concur- 
rent simulation of the live event. A remote game player can 
thea interact with the concurrent simulation by providing 
input to the concurrent simulation through a user interface. 
This system combines the excitement of a highly interactive 
video game with the drama and publicity surrounding a live 
event. The live event can thereby set the standard of per- 
formance for the concurrent simulation. Remote game play- 
ers may additionally compete against each other to deter- 
mine an overall global winner amongst the remote game 
players in the live event. 

47 Claims, 6 Drawing Sheets 
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SIMULATED REAL TIME GAME PLAY participants can place wagers on the outcome of the gam- 

WITH LIVE EVENT bling events. Implementing remote gambling systems of this 

type requires almost no interaction is required between the 

BACKGROUND remote participant and the live gambling event. The remote 

5 participant merely bets on the outcome of the gambling 

1. Field of Invention event, and does not try to "interact" with the gambling event 
The present invention relates to video games, computer as it is played. See for example, U.S. Pat. No. 4,339,798, 

simulations, computer networks, broadcast networks, and "Remote Gaming System," by Hedges, et al. In contrast, 

synchronization of distributed computing systems. In interactive games such as automobile racing require more 

particular, the present invention relates to providing a 10 "'ve interactive participation by game players, 

computer-based system which allows computer users to Telepresence systems allow users to navigate through and 

participate in a simulation of a live event at the same time selectively view a target locauon from a remote location. A 

V v . • , » * i telepresence svstem gathers input from sensors, such as 

the live event is taking place. ^ camerasand mic Vophones, located at a target location 

2. Related Art and transfers this input to the remote location. A user at the 
Video games are a popular form of entertainment finding 15 remote location can then guide the video camera and other 

widespread use in a variety of forms, including: standalone sensors located at the target location by manipulating a set 

video game systems, game cartridge systems connected to of controls at the remote location. In this way, a remote user 

television sets, and video game software for personal com- can navigate through and selectively view a target location 

puters. Thousands of video game titles are presently from a remote location. For example, see U.S. Pat. No. 

available, allowing video game players to participate in 20 5,495,576, "Panoramic Image Based Virtual Reality/ 

simulated activities as diverse as automobile racing, Telepresence Audio-Visual System and Method," by 

gambling, skiing, motorcycle racing, karate, and even aerial Ritchey. Although telepresence systems allow a remote user 

combat These simulated games typically allow a video '° view a target location, they do not facditate simulated 

game player to control the action of a simulated participant ^W 1100 m a IlVC CVent lakmg pUcC al thc targCt 
on a video game screen by manipulating various knobs, 25 

buttons, joysticks, trackballs, and keyboards. SUMMARY 

Video game players typically interact with and compete The present invention provides a method and apparatus 
against simulated opponents on a simulated course, thereby for simulating participation in a live event. It operates by 
setting an artificial standard of performance, which may be gathering input from the live event through sensors located 
quite different from the standard of performance required to 30 at the live event, and by gathering user input from a remote 
complete in a real live competitive event. Rather than participant through a user interface. 'Itiese inputs are trans- 
competing against each other directly, video game players milled to a computer system where they are used to generate 
typically compete against simulated opponents, and then a display of the simulation, which reflects what is actually 
later compare scores against these simulated opponents with happening at the live event, as well as the effect of user 
. » 35 commands on the live event simulation. The display 
other video game players. includes "entities" corresponding to real participants in the 
Some video games can be played across multiple com- Hve eyent as welI ^ "entities" corresponding to simulated 
puters which are connected together by a computer participants in the live event. 

network— even geographically distributed computer sys- For examp i ej the live event may be an automobile race, 

terns linked by cross-country computer networks. These 4[) Sensors a{ the race periodically record the position of real 

systems allow multiple players sitting at individual compul- automo bilcs participating in the race. This position infor- 

ers to participate in, and compete in, the same simulated matk)n [s rdaycd tQ lhc computcr systcm wncrc it is uscd t0 

video game. Players are able to compete against each other construct a disp i ay of the au tomobile race showing the real 

as well as simulated opponents, thereby adding a new veh i c ies in their proper locations. Commands received from 

dimension to the competition. Although these systems allow 45 (he usef imcrface contro , a sirau i ale d vehicle in the display, 

video game players to directly compete against each other, By issuing commands through lhe user interface, a remote 

they provide no indication as to how performance in a parl i c i panl navigates the simulated vehicle in and out of the 

multi-participant simulated game would translate into per- feal vehicles in the displaVt In tnis waVj the excitement a 

formance in a real live competitive event. highIy imeractive v j deo game is combined with the drama 

Interactive television systems allow television viewers to 50 and publicity surrounding a live event, 

participate in live broadcast events in a limited way, by The present invention allows remote participants to effec- 

providing a limited bandwidth bidirectional communication tively -compete" with the real participants in the live event, 

channel between the TV broadcast center and a hand held ^ hvc event can there b y set the standard of performance 

unit attached to a television set. Users can enter limited types for sirnuIate d participants in the live event. This differs 

of predictive or voting information into these handheld 55 s i gru fi cam iy f r0 m a conventional video game in which the 

units. This information is transferred back to the TV broad- slandard 0 f performance is entirely artificial, 

cast center where it is tabulated to determine polling results A gU)bal winDer can ^ delerraine d by gathering simula- 

or contest winners. For example, sec U.S. Pat. No. 5,526, (ion result& ff0m a lafge number of ^graphically distrib- 

035, "Transaction Based Interactive Television System," by med . through a re(urn communicalion channel. In 

Lappington, et al. However, these interactive television 60 thL$ way ^ ^^4^ millions of remote participants can 

systems typically have limited means for data input and lack compele in a sing]c simulation of a live eveni for the highest 

the processing power to support an interactive simulation of overall score. 

3 '^Tgambling systems allow wagering and betting on DESCR.PTION OF THE DRAWINGS 

live gambling events from remote locations. In these 65 FIG. 1 is diagram illustrating the structure of the method 

systems, live gambling events such as casino games or horse and apparatus for simulating participation with a live event 

races, are broadcast to remote locations, where remote in accordance with an aspect of the present invention. 
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FIG. 2 is a block diagram illustrating a number of possible Other sensors monitor atmospheric conditions. For 

sensors located at the live event for collection of data which example, a temperature sensor 210, such as a thermometer, 

is used to construct the simulation of the live event in keeps track of how hot or how cold a road surface is. A wind 

accordance with an aspect of the present invention. sensor 250 keeps track of wind conditions, for example, to 

FIG. 3 is a block diagram illustrating the structure of the 5 determine a sailboat's performance in a simulation of a 

computer system in which the live event simulation takes sailing event. A rain sensor 260 determines race course 

place in accordance with an aspect of the present invention. characteristics such as road slickness. 

FIG. 4 is a diagram illustrating an alternative structure for Other types of sensors collect sensory data. A light sensor 

the method and apparatus for simulating participation with 230 measures intensity of ambient lighting at live event 100 

a live event in accordance with an aspect of the present 30 to determine, for example, whether the live event 100 is 

invention taking place at night, so that the display of live event 100 can 

FIG. 5 is a flowchart illustrating the sequence of steps be modified to reflect nighttime conditions, 

which the system embodied in FIG. 1 goes through in order A video camera 230 gathers video images from different 

to provide a simulation of a live event in accordance with an locations within live event 100. In one embodiment of the 

aspect of the present invention. 15 present invention, a video camera 230 is mounted above the 

FIG 6 provides a simplified example of the display of the ^ event in a blimp to provide a bird's eye view of live 

simulation of a live event in the context of automobile racing event 100. In another embodiment, multiple video cameras 

in accordance with an aspect of the present invention, a ' c localcd at various strategic positions within live event 

100. In yet another embodiment, participants in live event 

DESCRIPTION 20 100 wear helmet cameras which provide participant per- 

The following description is presented to enable any spectives on live event 100. 

person skilled in the art to make and use the invention, and A microphone 280 monitors sound from live event 100. 

is provided in the context of a particular application and its This sound can be added to live event simulation 150 to 

requirements. Various modifications to the preferred 25 enhance the reality of live event simulation 150. For 

embodiment will be readily apparent to those skilled in the example, a large collection of microphones 280 located at 

art, and the general principles defined herein may be applied strategic positions within live event 100 create a sound 

to other embodiments and applications without departing mapping of live event 100. This sound mapping is used to 

from the spirit and scope of the invention. Thus, the present accurately reproduce sounds at different locations as a 

invention is not intended to be limited to the embodiment 3(J simulated participant navigates within live event 100. 

shown but is to be accorded the widest scope consistent with Finally, sensors 200, 210, 220, 230, 240, 250, 260, 270, 

the principles and features disclosed herein. and 280 all connect to preprocessor 120. 

FIG. 1 is a functional block diagram of the major func- Referring again to FIG. 1, preprocessor 120 performs a 
tional components in a system for simulating participation number of operations on the data gathered through sensors 
with a live event according to one embodiment of the present 35 110, including, for example: extraction of position informa- 
invention. A collection of sensors 110 at various locations in tkm from a video signal through image recognition software, 
a live event 100 gather data to be used in remote simulations and compression of data collected through sensors 10 in 
of live event 100. These sensors 110 connect to preprocessor preparation for transport across network 130 to remote 
120, which assembles the data collected from sensors 110 in computer systems 140, 142 and 144. In another 
preparation for transmission across network 130. Network 40 embodiment, preprocessor 120 contains very little comput- 
130 connects preprocessor 120 to a collection of remote ing power, and merely provides simple data routing clc- 
computer systems 140, 142 and 144. These remote computer mcnts which transmit raw data from sensors 110 to corn- 
systems 140, 142 and 144, contain separate live event puters 140, 142 and 144. In yet another embodiment, 
simulations 150, 152, and 154, respectively. Game players preprocessor 120 provides sophisticated compression and 
160, 162, and 164, sitting at computers 140, 142, and 144, 45 filtering functions, requiring special purpose hardware for 
interact with live event simulations 150, 152, and 154. In digital signal processing, as well as a central processing unit 
particular, player 160 interacts with live event simulation connected to a full computational system. Preprocessor 120 
150 on remote computer system 140. Player 162 interacts also buffers data from sensors 110. ITiis allows data col- 
with live event simulation 152 on remote computer system lected from sensors 110 to be assembled and temporarily 
142. And, player 164 interacts with live event simulation 50 stored before transmission across network 130. According to 
154 on remote computer system 144. one embodiment of the present invention, preprocessor 120 

Live event 100 can be any type of competitive or partici- includes dedicated hardware to convert analog signals from 

patory event in which remote participants would be inter- sensors 110 into digital form for transport over network 130. 

ested in participating in. This includes, but is not limited to, Network 130 transports data from preprocessor 120 to 

automobile racing, sailboat racing, motorcycle racing, 55 computers 140, 142 and 144. In one embodiment, network 

skiing, bobsledding and even aerial combat. Other types of 130 comprises a computer network, such as the Internet, 

participatory activities such as gambling, lotteries and board used to transmit a stream of data from preprocessor 120 to 

games also qualify as live events. remote computer systems 140, 142 and 144. In one 

FIG. 2 illustrates a variety of sensors 110 located within embodiment, this stream of data includes a digitized video 

live event 100. Position sensor 200 detects the position of a 60 signal. In another embodiment, network 130 is a wireless 

vehicle or a participant in live event 100. In one embodiment computer network. In yet another embodiment, network 130 

of the present invention, position sensor 200 takes the form is a broadcast television network, which transmits a video 

of a global positioning system (GPS) location sensor. Speed signal and other data from preprocessor 120 to remote 

sensor 220 monitors the speed of various participants in live computer systems 140, 142 and 144. According to another 

event 100. Speed sensor 220 may take the form of an internal 65 embodiment, network 130 is a dedicated cable television 

monitor (on the speedometer of a vehicle, for example) or an network. In yet another embodiment, network 130 is a 

external speed measurement system (radar, for example). collection of telephone lines. 
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FIG. 3 is a block diagram illustrating the structure of a ing to both simulated participants and real participants in 

remote computer system 140, which contains live event live event 100. Rules encoded in live event simulation 150 

simulation 150. Remote computer system 140 comprises a govern how these simulated and real entities interact with 

central processing unit (CPU) 300 connected to bus 310. Bus each other in live event simulation 150. For example, 

310 connects CPU 300 to disk drive 320, display 380 and 5 according to one embodiment of the present invention, a rule 

memory 330. Memory 330 contains executable computer specifies that a simulated entity cannot occupy the same 

code and data 340 for live event simulation 150. Bus 310 physical space as a real entity. If a player attempts to move 

also connects CPU 300 to a number of data input devices a simulated entity into the same physical space as a real 

including, but not limited to: mouse 360, joystick 370, and entity, the simulated entity will move a close as possible to 

keyboard 350. Other input devices may be connected to 3Q the real entity, but will be prevented from occupying the 

remote computer system 140. For example, a microphone same physical space as the real entity in live event simula- 

with voice recognition software or even a video camera with tion 150. 

image recognition software. Finally, network interface 340 According to one embodiment of the present invention, 

connects remote computer system 140 to network 130 (from two types of interactions are regulated by live event simu- 

FIG. 3). Network interface 340 may take the form of an i5 lation 150: (1) interactions between simulated participants; 

Ethernet transceiver, a television broadcast receiver or any anc ] (2) interactions between real participants and simulated 

other interface compatible with network 130. participants. A game designer has great flexibility is speci- 

FIG. 4 is a functional block diagram of a system for fying rules governing interactions between simulated 

simulating participation in a live event according to another participants, because live event simulation 150 has complete 

embodiment of the present invention. This embodiment is 2Q control over the actions and reactions of simulated partici- 

the same as the embodiment illustrated in FIG. 1, except for pants. However, a game designer has less flexibility in 

the fact that preprocessor 120 in FIG. 1 has been replaced specifying rules governing interactions between real partici- 

with a central computer system 400 in FIG. 4. This embodi- pants and simulated participants, because live event 100 

ment differs from the embodiment shown in FIG. 1 where proceeds completely independently of the simulated partici- 

the live event simulation takes place completely at remote 25 pants. Consequently, real participants from live event 100 

computer systems 140, 142 and 144. In the embodiment cannot "react" to actions of the simulated participants with- 

shown in FIG. 4, central computer system 400 takes input out deviating the from live event 100. Nevertheless, limited 

from sensors 110 and uses this input to create a centralized forms of interaction between simulated and real participants 

live event simulation 410. Live event simulation 410 takes can be imbedded in live event simulation 150. For example, 

user input from players 160, 162 and 164 located at remote 3Q in a simulation of an automobile race, a simulated vehicle 

computer systems 140, 142 and 144, and uses this input, ma y be obliged to give way to let a real vehicle pass, and 

along with input from sensors 110, to determine the course collisions between simulated vehicles may not be allowed to 

of live event simulation 410. Bidirectional cpmmunication affect real vehicles. 

takes place across network 130 between central computer One embodiment of the present invention provides facili- 

system 400 and remote computer systems 140, 142 and 144. 35 ties for a game designer to develop a customized set of rules 

In one embodiment, at least part of the live event simu- to govern interactions between participants in live event 

lation takes place at central computer system 400, and other simulation 150. 

parts of the live event simulation 150, 152, and 154, take \ n onc embodiment of the present invention, simulated 
place in remote computer systems 140, 142 and 144. In participants arc forced to assume the position of the closest 
another embodiment, the entire live event simulation 410 40 rea i participant in live event 100 in order to avoid excessive 
takes place at central computer system 400, and remote congestion. For example, in automobile racing, a simulated 
computer systems 140, 142 and 144 merely function as vehicle is forced to assume the position of the closest real 
display and data input devices, such as computer terminals, vehicle. The simulated vehicle then engages in "micro- 
According to another embodiment of the present invention, tactics" in the neighborhood of the closest real vehicle. If the 
the live event simulation is divided into multiple pieces and 45 position of the simulated vehicle deviates significantly from 
these pieces are executed across a number of nodes of a the closest real vehicle, the simulated vehicle '^breaks away" 
distributed computing system. r rom the real vehicle, and assumes its own independent 

FIG. 5 is a flowchart illustrating how live event simulation position, 

150 operates according to one embodiment of the present Live event simulation 150 is synchronized with live event 

invention. At step 500, computer system 140 (illustrated in 50 ioo so that display 380 of live event simulation 150 appears 

FIG. 3) generates a display 380 of live event 100, which is t o be substantially simultaneous with live event 100 to a 

viewed by player 160. At step 5 10, live event simulation p i ay er 160 of live event simulation 150. Synchronization 

150 gathers "event" input from live event 100 through between live event 100 and live event simulations 150, 152 

sensors 110. At step 520, this event input is used to modify an j 154 al rem „i c computer systems 140, 142 and 144, is 

display 380 to properly reflect the current state of live event 55 accomplished in a number of ways. In one embodiment of 

100. At step 530, computer system 140 receives "user" input tne present invention, a television signal transmits informa- 

from player 160. At step 540, this user input is used to update t ion between live event 100 and computers 140, 142 and 

display 380 to reflect the effect of user commands on live 144^ anc j synchronization information is encoded in the 

event simulation 150. television signal by modulation or by transmitting it during 

FIG. 5 illustrates one possible ordering of steps 500, 510, 60 the vertical blanking interval ( VBI) of the television signal. 
520, 530 and 540. Many alternative orderings of these steps If network 130 is a computer network, periodic transmis- 
are possible. The only requirement is that display 380 of sions over the computer network 130 are used to synchro- 
computer system 140 be periodically updated to reflect the n ize live event simulation 150 with live event 100. In one 
evolution of live event 100, and the effect of commands embodiment, the process of synchronization is simplified by 
received from player 160. 65 delaying the broadcast ol" live event 100 to allow time for 

According to one embodiment of the present invention, processing of data collected from the live event 100 and for 

display 3 80 of live event 100 contains entities correspond- transmission over network 130 to remote computer systems 
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140, 142 and 144. In yet another embodiment, live event 
simulation 150 is synchronized with a recorded playback of 
live event 100. 

According to one embodiment of the present invention, 
synchronization between live event 100 and live event 5 
simulation 150 is maintained by interpolation. Periodic 
transmissions from live event 100 are used to update live 
event simulation 150. Between these periodic transmissions, 
the live event simulation 150 interpolates the position of real 
and simulated participants according to a set of rules, (for ]0 
example, the laws of motion), until another periodic trans- 
mission is received from live event 100. When received, the 
periodic transmission from live event 100 is used to correct 
any divergence of live event simulation 150 from live event 

100 15 

In one embodiment of the present invention, computer- 
generated images of simulated participants are mixed with a 
live video feed from live event 100. This is accomplished by 
digitizing the video feed and overwriting it with computer- 
generated images of the simulated participants. In another 
embodiment, it is accomplished by selectively mixing the 20 
analog video signal from live event 100 and a computer- 
generated analog signal. In order to achieve a realistic 
appearance, live event simulation 150 uses appropriate light- 
ing and shading models to generate images of simulated 
participants in live event 100. 25 

One embodiment of the present invention supports simu- 
lated participation with a playback of a recording of a live 
event 100. Information gathered from live event 100 through 
sensors 110 is recorded, and then later played back. Live 
event simulation 150 uses this recorded playback as if it 30 
were live input for purposes of creating a live event simu- 
lation 150 based on a recording of live event 100. This 
recorded playback feature makes it possible to simulate 
participation in a live event 100 which happened in the past. 
This allows a player 160 to practice many times against the 35 
same recorded live event 100, and to try out a number of 
strategies against the same recorded live event 100. 

One embodiment of the present invention provides a 
facility to collect scoring information from live event simu- 
lations 150, 152 and 154. A return communication channel 40 
(for example, network 130) is used to gather scoring infor- 
mation from remote live event simulations 150, 152, and 
154 at a central location (possibly preprocessor 120), where 
this scoring information tabulated. A global winner can thus 
be determined for all remote simulations. 45 
Live Event Simulation Example 

FIG. 6 illustrates the display 380 for simulated participa- 
tion in an automobile race according to one embodiment of 
the present invention. In this example, display 380 com- 
prises a driver's view of the race from a simulated vehicle. 50 
See FIG. 6. Referring to FIG. 1, sensors 110 gather position 
information for vehicles in live event 100, which in tins 
example is an automobile race. Radio transmitters in each 
race vehicle transmit position information to a receiver with 
directional antennae which determines the position of each 55 
vehicle in the race. This position information is collected in 
preprocessor 120 where it is organized into an ordered list, 
and compressed for transmission. Next, the compressed 
position information is transmitted over network 130 to 
remote computer system 140, 60 

Remote computer system 140 uses the position informa- 
tion to construct a three-dimensional representation of the 
real vehicles in the race. A display 380 of the driver's view 
is constructed by taking a projection of this three dimen- 
sional model from the perspective of a driver located in a 65 
simulated vehicle. Only vehicles directly within the simu- 
lated driver's view are visible in display 380. 
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Display 380 is updated at video rates, which potentially 
creates a problem because the video display may have to be 
updated more frequently than position information is 
received from sensors 110. Live event simulation 150 inter- 
polates the positions of real vehicles in the race between 
periodic updates. This involves predicting the position of 
real vehicles in display 380 on the basis of prior position 
information. First, the velocity of a real vehicle is deter- 
mined by examining the vehicle's position during several of 
the preceding measurements. Next, this velocity is used to 
predict the path of a vehicle in future video frames. When 
new position information is finally received from sensors 
110, this new position information is used to correct any 
divergence which may have occurred between the predicted 
position and actual position of the real vehicle. 

User commands control the position of a simulated 
vehicle. Remote computer system 140 receives input from 
player 160 through joystick 370 connected to remote com- 
puter system 140. Joystick 370 transmits steering, accelera- 
tion and braking commands to remote computer system 140. 
Inside remote computer system 140, live event simulation 
150 uses these commands to alter the path of the simulated 
vehicle in live event simulation 150. This may change the 
simulated driver's view, and hence change the display 380 
of live event simulation 150. For example, if player 160 
steers to the right, the display 380 will be updated so that it 
appears the simulated automobile has moved to the right; 
this means the scenery and other cars in display 380 will 
shift to the left. 

Interactions between simulated vehicles and real vehicles 
or between simulated vehicles and other simulated vehicles 
are governed by rules. For example, a simulated vehicle 
must yield, and will automatically do so, when a real vehicle 
attempts to pass. A real vehicle will also yield when a 
simulated vehicle is attempting to pass. This is accomplished 
by altering the path of a real vehicle to allow a simulated 
vehicle to pass, and then moving the real vehicle back to its 
actual path. 

'I*he simulation also accounts for the slipstream of air 
behind real and simulated vehicles, which allows trailing 
vehicles to draft on vehicles ahead of them, saving fuel and 
increasing speed. Drafting is possible in a number of situ- 
ations. Simulated vehicles may draft on the slipstreams 
which follow real vehicles. Simulated vehicles may draft on 
the slipstreams of other simulated vehicles. However, real 
vehicles are not influenced in any way by the slipstreams of 
simulated vehicles, otherwise the position of a real vehicle 
in live event simulation 150 might deviate significantly from 
its actual position in live event 100. 

If a simulated vehicle gets too close to a real vehicle, the 
simulated vehicle assumes the position of the real vehicle. 
Iriis avoids congestion problems due to simulated vehicles 
clogging up the spaces between real vehicles. Most 
commonly, simulated vehicles assume the position of real 
vehicles at the start of an automobile race, when real 
vehicles are stacked up in tight formation behind the starling 
line. Alternatively, a simulated vehicle may start at the end 
of the pack behind all of the real vehicles, in last position. 

The simulation of the automobile race according to the 
present example allows for concurrent participation by mul- 
tiple simulated vehicles operated by multiple players. A 
collection of players 160, 162 and 164, interacting with 
computers 140, 142 and 144, are joined into a group of 
simulated participants. These simulated participants interact 
with each other in the same simulation of live event 100, 
which lakes place locally at computers 140, 142 and 144. As 
simulated vehicles change posiiion.position information for 
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the simulated vehicles is broadcast between computers 140, 
142 and 144, allowing live event simulations 150, 152 and 
154, to update the positions of other simulated vehicles. 

According to another embodiment of the present 
invention, preprocessor 120 keeps track of the locations of 5 
the simulated players. For example, remote computer sys- 
tems 140, 142 and 144, broadcast the position of simulated 
vehicles corresponding to players 160, 162 and 164 to 
preprocessor 120. Preprocessor 120 then broadcasts this 
position information to all of the other remote computer 10 
systems participating in the same simulation. 

Access to a particular simulation, involving a group of 
simulated players, is restricted to a limited number of 
simulated players in order to avoid problems of overcrowd- 
ing. If large numbers of players want to participate in the is 
same event, they each send a "request to participate 1 ' to 
preprocessor 120. Preprocessor 120 then divides the remote 
participants into groups of limited size. Each group is 
associated with a separate simulation of live event 100, 
thereby avoiding overcrowding. Simulated race cars then 20 
interact with only simulated race vehicles from their group 
in addition to the real race vehicles. As additional remote 
users join a live event simulation, they will be combined into 
additional limited groups, members of which will only be 
able to interact with each other and the real race cars. 25 

The foregoing description of a preferred embodiment of 
the invention has been presented for purposes of illustration 
and description. It Is not intended to be exhaustive or to limit 
the invention to the precise forms disclosed. Obviously, 
many modifications and variations will be apparent to prac- 30 
titioncrs skilled in the art. 

What is claimed is: 

1. In a computer system with a user interface, a method 
for simulating interaction with a live event comprising: 

generating a display representing said live event in said 35 
computer system, wherein said display comprises a 
plurality of entities corresponding to real participants in 
said live event and at least one simulated entity, which 
correspond to at least one simulated participant in said 
live event, and positions of said plurality of entities 40 
corresponding to real participants are not controlled in 
response to said user inputs; 

gathering event input from at least one sensor located at 
said live event; 

45 

modifying said display according to said event input; 
receiving user input from said user interface; and 
modifying said display according to said user input. 

2. The method of claim 1 including controlling a position 
in said display of said at least one simulated entity in 50 
response to said user inputs. 

3. The method of claim 1 including modifying said 
plurality of entities according to one or more rules of 
engagement, which specify an interaction involving said at 
least one simulated entity and said at least one real entity. 55 

4. The method of claim 3 wherein more than one simu- 
lated entity exists, and said rules of engagement specify how 
said simulated entities interact with each other. 

5. The method of claim 3 wherein said at least one rule of 
engagement includes a rule requiring a simulated entity to 60 
assume the position of a real entity when said simulated 
entity is closer than a specified distance from said real entity. 

6. The method of claim 3 including modifying said 
plurality of rules of engagement according to said user input. 

7. Ifie method of claim 1 further including periodically 65 
synchronizing said display with said live event, such that 
said event input gathered at a first time is reflected in said 



display at a second time, wherein a time interval between 
said first time and said second time is such that the display 
appears to be substantially simultaneous with said live event 
to a user of said computer system. 

8. The method of claim 1 wherein said event input 
includes position information for at least one real participant 
in said live event. 

9. The method of claim 1 wherein said computer system 
is located remotely from said live event, and said gathering 
event input further comprises: 

transmitting said event input through a communication 
channel; and 

receiving said event input at said computer system. 

10. The method of claim 9 wherein said communication 
channel comprises a computer network. 

11. The method of claim 9 wherein said communication 
channel comprises broadcast television. 

12. The method of claim 9 wherein said communication 
channel comprises a cable television network. 

13. In a computer system with a user interface, a method 
for simulating interaction with a live event comprising: 

generating a display representing said live event in said 
computer system, wherein said display comprises a 
plurality of entities corresponding to real participants in 
said live event and at least one simulated entity, which 
correspond to at least one simulated participant in said 
live event and positions of said plurality of entities 
corresponding to real participants are not controlled in 
response to said user inputs; 
gathering event input from at least one sensor located at 

said live event, 
modifying said display according to said event input; 
receiving user input from said user interface; and 
modifying said display according to said user input; and 
periodically synchronizing said display with a broadcast 
of said event input gathered from said live event, such 
that said event input, which is broadcast at a first time, 
is reflected in said display at a second lime, wherein a 
time interval between said first time and said second 
time is such that the display appears to be substantially 
simultaneous with said broadcast of said event input to 
a user of said computer system. 

14. In a computer system with a user interface, a method 
for simulating interaction with a live event comprising: 

generating a display representing said live event in said 
computer system, wherein said display comprises a 
plurality of entities corresponding to real participants in 
said live event and at least one simulated entity, which 
correspond to at least one simulated participant in said 
live event and positions of said plurality of entities 
corresponding to real participants are not controlled in 
response to said user inputs; 

gathering event input from at least one sensor located at 
said live event; 

modifying said display according to said event input; 

receiving user input from said user interface, 

modifying said display according to said user input; 

periodically synchronizing said display with a playback of 
a recording of said event input gathered from said live 
event, such that said event input, which is played back 
from a recording at a first time, is reflected in said 
display at a second time, wherein a time interval 
between said first time and said second lime is such that 
the display appears to be substantially simultaneous 
with said playback to a user of said computer system. 
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15. In a computer system with a user interface, a method 
for simulating interaction with a live event comprising: 

generating a display representing said live event in said 
computer system, wherein said display comprises a 
plurality of entities corresponding to real participants in 5 
said live event and at least one simulated entity, which 
correspond to at least one simulated participant in said 
live event and positions of said plurality of entities 
corresponding to real participants are not controlled in 
response to said user inputs; 10 

gathering event input from at least one sensor located at 
said live event; 

modifying said display according to said event input; 

receiving user input from said user interface, 15 

modifying said display according to said user input; 

gathering scoring information from said computer sys- 
tem; 

communicating said scoring information to a central data 
collection site; and 20 

receiving and assembling scoring information from at 
least one other computer system at said central data 
collection site. 

16. In a computer system with a user interface, a method 
for simulating interaction with a live event comprising: 25 

generating a display representing said live event in said 
computer system, wherein said display comprises a 
plurality of entities corresponding to real participants in 
said live event and at least one simulated entity, which 
correspond to at least one simulated participant in said 
live event and positions of said plurality of entities 
corresponding to real participants are not controlled in 
response to said user inputs; 

gathering event input from at least one sensor located at 35 
said live event; 

modifying said display according to said event input; 

receiving user input from said user interface; 

modifying said display according to said user input; 

wherein said event input includes environmental condi- 40 
tions from said live event that effect performance of 
said plurality of participants in said live event. 

17. The method of claim 16 wherein said environmental 
conditions include wind velocity. 

18. The method of claim 16 wherein said environmental 45 
conditions include road slickness. 

19. In a computer system with a user interface, a method 
for simulating participation in a live sporting event com- 
prising: 5q 

generating a display representing said live sporting event 
in said computer system, wherein said display com- 
prises a plurality of entities corresponding to partici- 
pants in said live event, and wherein said plurality of 
entities includes at least one real entity which corre- 
sponds to at least one real participant in said live event, 55 
and a simulated entity, which corresponds to a simu- 
lated participant in said live event; 

gathering position information about said at least one real 
entity in said live event from at least one sensor located 
at said live sporting event; 

modifying a position of said at least one real entity in said 
display using said position information; 

receiving a user command from said user interface; and 

modifying a position of said simulated entity in said 65 
display using said user command and according to at 
least one rule of engagement requiring a simulated 
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entity to assume the position of a real entity when said 
simulated entity is closer than a specified distance from 
said real entity. 

20. In a computer system with a user interface, a method 
for simulating participation in a live sporting event com- 
prising: 

generating a display representing said live sporting event 
in said computer system, wherein said display com- 
prises a plurality of entities corresponding to partici- 
pants in said live event, and wherein said plurality of 
entities includes at least one real entity, which corre- 
sponds to at least one real participant in said live event, 
and a simulated entity, which corresponds to a simu- 
lated participant in said live event; 

gathering position information about said at least one real 
entity in said live event from at least one sensor located 
at said live sporting event; 

modifying a position of said at least one real entity in said 
display using said position information; 

receiving a user command from said user interface; 

modifying a position of said simulated entity in said 
display using said user command; and 

periodically synchronizing said display with a broadcast 
of said event input gathered from said live event, such 
that said event input, which is broadcast at a first time, 
is reflected in said display at a second time, wherein a 
time interval between said first time and said second 
time is such that the display appears to be substantially 
simultaneous with said broadcast of said event input to 
a user of said computer system. 

21. In a computer system with a user interface, a method 
for simulating participation in a live sporting event com- 
prising: 

generating a display representing said live sporting event 
in said computer system, wherein said display com- 
prises a plurality of entities corresponding to partici- 
pants in said live event, and wherein said plurality of 
entities includes at least one real entity, which corre- 
sponds to at least one real participant in said live event, 
and a simulated entity, which corresponds to a simu- 
lated participant in said live event; 

gathering position information about said at least one real 
entity in said live event from at least one sensor located 
at said live sporting event; 

modifying a position of said at least one real entity in said 
display using said position information; 

receiving a user command from said user interface; 

modifying a position of said simulated entity in said 
display using said user command; and 

periodically synchronizing said display with a playback of 
a recording of said event input gathered from said live 
event, such that said event input, which is played back 
from a recording at a first time, is reflected in said 
display at a second time, wherein a time interval 
between said first time and said second time is such that 
the display appears to be substantially simultaneous 
with said playback to a user of said computer system. 

22. In a computer system with a user interface, a method 
tor simulating participation in a live sporting event com- 
prising: 

generating a display representing said live sporting event 
in said computer system, wherein said display com- 
prises a plurality of entities corresponding to partici- 
pants in said live event, and wherein said plurality of 
entities includes at least one real entity, which corre- 
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spoocis to at least one real participant in said live event 
and a simulated entity, which corresponds to a simu- 
lated participant in said live event; 

gathering position information about said at least one real 
entity in said live event from at least one sensor located 5 
at said live sporting event; 

modifying a position of said at least one real entity in said 
display using said position information; 

receiving a user command from said user interface; 

modifying a position of said simulated entity in said 
display using said user command; 

gathering scoring information froi i said computer sys- 
tem; 

communicating this scoring information to a central data 15 

collection site; and 
receiving and assembling scoring information from at 

least one other computer system at said central data 

collection site. 

23. In a computer system with a user interface, a method 
for simulating participation in a live sporting event com- 
prising: 

generating a display representing said live sporting event 
in said computer system, wherein said display com- 25 
prises a plurality of entities corresponding to partici- 
pants in said live event, and wherein said plurality of 
entities includes at least one real entity, which corre- 
sponds to at least one real participant in said live event, 
and a simulated entity, which corresponds to a simu- 30 
lated participant in said live event; 

gathering position information about said at least one real 
entity in said live event from at least one sensor located 
at said live sporting event wherein said event input 
includes environmental conditions from said live event 35 
that effect performance of said plurality of participants 
in said live event; 

modifying a position of said at least one real entity in said 
display using said position information; 

receiving a user command from said user interface; 40 

modifying a position of said simulated entity in said 
display using said user command. 

24. The method of claim 23 wherein said environmental 
conditions include wind velocity. 

25. The method of claim 23 wherein said environmental 45 
conditions include road slickness. 

26. In a computer system with a user interface, a method 
for simulating participation in a live sporting event wherein 
said computer system is located remotely from said live 
event, comprising: 50 

generating a display representing said live sporting event 
in said computer system, wherein said display com- 
prises a plurality of entities corresponding to partici- 
pants in said live event, and wherein said plurality of 
entities includes at least one real entity, which corre- 55 
sponds to at least one real participant in said live event, 
and a simulated entity, which corresponds to a simu- 
lated participant in said live event; 

gathering position information about said at least one real 6Q 
entity in said live event from at least one sensor located 
at said live sporting event; 

transmitting said position information through a commu- 
nication channel to said computer system; 

modifying a position of said at least one real entity in said 65 
display using said position information; 

receiving a user command from said user interface; 
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modifying a position of said simulated entity in said 
display using said user command. 

27. The method of claim 26 wherein said communication 
channel comprises a computer network. 

28. The method of claim 26 wherein said communication 
channel comprises broadcast television. 

29. The method of claim 26 wherein said communication 
channel comprises a cable television network. 

30. An apparatus for simulating interaction with a live 
event comprising: 

at least one sensor for gathering event input from said live 
event; 

a computer system including a user interface, wherein 
said user interface includes a display; 

a communication channel connecting said at least one 
sensor to said computer system for transferring said 
event input to said computer system; 

wherein said computer system generates a display repre- 
senting said live event, said display comprising a 
plurality of entities corresponding to real participants in 
said live event and at least one simulated entity, which 
correspond to at least one simulated participant in said 
live event; 

wherein said computer system receives user input from 

said user interface; 
wherein said computer system periodically modifies said 

display according to said user input and said event 

input; and 

wherein positions in said display of said plurality of 
entities corresponding to real participants are not con- 
trolled in response to said user inputs. 

31. The apparatus of claim 30 where a position in said 
display of said at least one simulated entity is controlled in 
response to said user inputs. 

32. The apparatus of claim 30 including wherein said 
plurality of entities is modified according one or more rules 
of engagement, which specify an interaction involving said 
at least one simulated entity and said at least one real entity. 

33. The apparatus of claim 32 wherein more than one 
simulated entity exists, and said rules of engagement specify 
how said simulated entities interact with each other. 

34. The apparatus of claim 32 wherein said at least one 
rule of engagement includes a rule requiring a simulated 
entity to assume the position of a real entity when said 
simulated entity is closer than a specified distance from said 
real entity. 

35. The apparatus of claim 32 wherein said rules of 
engagement are modified according to said user input. 

36. The apparatus of claim 30 wherein said display of said 
live event is initially generated from said event input gath- 
ered from said at least one sensor at said live event. 

37. The apparatus of claim 30 wherein said display is 
periodically synchronized with said live event, such that said 
event input gathered at a first lime is reflected in said display 
at a second time, wherein a time interval between said first 
time and said second time is such that the display appears to 
be substantially simultaneous with said live event to a user 
of said computer system. 

38. An apparatus for simulating interaction with a live 
event comprising: 

at least one sensor for gathering event input from said live 
event; 

a computer system including a user interface, wherein 

said user interface includes a display; 
a communication channel connecting said at least one 

sensor to said computer system for transferring said 

event input to said computer system; 
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wherein said computer system gene rates a display repre- 
senting said live event, said display comprising a 
plurality of entities corresponding to real participants in 
said live event and at least one simulated entity, which 
correspond to at least one simulated participant in said 
live event; 

wherein said computer system receives user input from 

said user interface; 
wherein said computer system periodically modifies said 

display according to said user input and said event 

input; and 

wherein said display is periodically synchronized with a 
broadcast of said event input gathered from said live 
event, such that said event input, which is broadcast at 
a first time, is reflected in said display at a second time, 
wherein a time interval between said first time and said 
second time is such that the display appears to be 
substantially simultaneous with said broadcast of said 
event input to a user of said computer system. 

39. An apparatus for simulating interaction with a live 
event comprising; 

at least one sensor for gathering event input from said live 
event; 

a computer system including a user interface wherein said 
user interface, includes a display; 

a communication channel connecting said at least one 
sensor to said computer system for transferring said 
event input to said computer system; 

wherein said computer system generates a display repre- 
senting said live event, said display comprising a 
plurality of entities corresponding to real participants in 
said live event and at least one simulated entity, which 
correspond to at least one simulated participant in said 
live event; 

wherein said computer system receives user input from 

said user interface; 
wherein said computer system periodically modifies said 

display according to said user input and said event 

input; and 

wherein said display is periodically synchronized with a 
playback of a recording of said event input gathered 
from said live event, such that said event input, which 
is played back from a recording at a first time, is 
reflected in said display at a second lime, wherein a 
lime interval between said first time and said second 
time is such that the display appears to be substantially 
simultaneous with said playback to a user of said 
computer system. 

40. An apparatus for simulating interaction with a live 
event comprising: 

at least one sensor for gathering event input from said live 
event; 

a computer system including a user interface, wherein 
said user interface includes a display; 

a communication channel connecting said at least one 
sensor to said computer system for transferring said 
event input to said computer system; 

wherein said computer system generates a display repre- 
senting said live event, said display comprising a 
plurality of entities corresponding to real participants in 
said live event and at least one simulated entity, which 
correspond to at least one simulated participant in said 
live event; 

wherein said computer system receives user input from 
said user interface; 
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wherein said computer system periodically modifies said 
display according to said user input and said event 
input; and 

including a central data collection site which gathers and 
assembles scoring information from said computer 
system and at least one other computer system. 

41. An apparatus for simulating interaction with a live 
event comprising: 

at least one sensor for gathering event input from said live 
event; 

a computer system including a user interface, wherein 
said user interface includes a display; 

a communication channel connecting said at least one 
sensor to said computer system for transferring said 
event input to said computer system; 

wherein said computer system generates a display repre- 
senting said live event, said display comprising a 
plurality of entities corresponding to real participants in 
said live event and at least one simulated entity, which 
correspond to at least one simulated participant in said 
live event; 

wherein said computer system receives user input from 

said user interface; 
wherein said computer system periodically modifies said 

display according to said user input and said event 

input; and 

wherein said event input includes position information for 
at least one real participant in said live event. 

42. An apparatus for simulating interaction with a live 
event comprising: 

at least one sensor for gathering event input from said live 
event: . . 

a computer system including a user interface, wherein 
said user interface includes a display; 

a communication channel connecting said at least one 
sensor to said computer system for transferring said 
event input to said computer system; 

wherein said computer system generates a display repre- 
senting said live event, said display comprising a 
plurality of entities corresponding to real participants in 
said live event and at least one simulated entity, which 
correspond to at least one simulated participant in said 
live event; 

wherein said computer system receives user input from 

said user interface; 
wherein said computer system periodically modifies said 

display according to said user input and said event 

input; and 

wherein said event input includes environmental condi- 
tions from said live event that effect performance of 
said plurality of participants in said live event. 

43. The apparatus of claim 42 wherein said environmental 
conditions include wind velocity. 

44. ITie apparatus of claim 42 wherein said environmental 
conditions include road slickness. 

45. An apparatus for simulating interaction with a live 
event comprising: 

at least one sensor for gathering event input from said live 
event; 

a computer system including a user interface, wherein 

said user interface includes a display; 
a communication channel connecting said at least one 

sensor to said computer system for transferring said 

event input to said computer system; 
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wherein said computer system generates a display repre- 
senting said Live event, said display comprising a 
plurality of entities corresponding to real participants in 
said live event and at least one simulated entity, which 
correspond to at least one simulated participant in said 5 
live event; 

wherein said computer system receives user input from 

said user interface; 
wherein said computer system periodically modifies said 

display according to said user input and said event 

input; and 

wherein said communication channel comprises a com- 
puter network. 

46. An apparatus for simulating interaction with a live J5 
event comprising: 

at least one sensor for gathering event input from said live 
event; 

a computer system including a user interface, wherein 
said user interface includes a display; 20 

a communication channel connecting said at least one 
sensor to said computer system for transferring said 
event input to said computer system; 

wherein said computer system generates a display repre- 
senting said live event, said display comprising a 
plurality of entities corresponding to real participants in 
said live event and at least one simulated entity, which 
correspond to at least one simulated participant in said 
live event; 30 

wherein said computer system receives user input from 
said user interface; 
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wherein said computer system periodically modifies said 
display according to said user input and said event 
input; and 

wherein said communication channel comprises broad- 
cast television. 
47. An apparatus for simulating interaction with a live 
event comprising: 

at least one sensor for gathering event input from said live 
event; 

a computer system including a user interface, wherein 

said user interface includes a display; 
a communication channel connecting said at least one 

sensor to said computer 
system for transferring said event input to said computer 
system; 

wherein said computer system generates a display repre- 
senting said live event, said display comprising a 
plurality of entities corresponding to real participants in 
said live event and at least one simulated entity, which 
correspond to at least one simulated participant in said 
live event; 

wherein said computer system receives user input from 

said user interface; 
wherein said computer system periodically modifies said 
display according to said user input and said event 
input: and 

wherein said communication channel comprises a cable 
television network. 

***** 
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